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Faust 

Speed up audio application and plug-in development 

Faust offers an abstract high-level notation to describe DSP 
algorithms in a concise and effective manner. 
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Faust 

Develop once, deploy everywhere 


Audio applications designers have to deploy their work on a variety 
of platforms (Linux, OSX, Windows, Android, iOS, embedded 
devices, etc). One of Faust strong idea is to write the DSP once 
en easily deploy it on a wide number of systems. 
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Faust 

Make Faust compilation technology widely usable 



Faust compilation technology is accessible using the online 
compiler, the embedded compiler library version, or the 
FaustWeb remote compilation API that produces various target 
binaries. 


FaustLive with FaustWeb access 


Faust in Max/MSP (faustgen 
using libfaust.so) 
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Audio on the WEB 


WEB technologies like asm.js, Web Audio API or Web 
components aim to change the way we design, publish and share 
musical applications. Using this technologies procedural content 
can now be shared and combined as easily as multimedia content \ 
Grame offers several Web technologies : 

■ libfaust.js + asm.js target (emcripten + Faust backend) 

: embeddable JavaScript/asm.js Faust compiler 

■ FaustWeb : remote multi-targets compilation API 

■ Faust Playground : simplifying Faust programs design 


Audio on the WEB 

Targeting the Web Audio API (1) 


The Web Audio API is a high-level JavaScript API for processing 
and generating audio in Web applications : 

■ native optimized C++/assembly nodes 

■ JavaScript/asm.js ScriptProcessor nodes 

■ connected to create an audio generating/processing graph 


Audio on the WEB 

Targeting the Web Audio API (2) 


How to generate ScriptProcessor nodes ? 

■ they can be ’’manually written” in pure JavaScript 

■ or in asm.js for better performances (but this is difficult...) 

■ or automatically generated from DSP code already written 
C/C++... (emscripten) 

■ or automatically generated from a Domain Specific 
Language 


Audio on the WEB 

Asm.js code generation (1) 


Asm.js is developed by Mozilla along with Emscripten : 

■ asm.js : an extremely restricted subset of JavaScript that 
provides only strictly-typed integers, floats, arithmetic, 
function calls, and heap accesses (using typed arrays). 

■ asm.js variables, computation, return values types are 
annotated 

■ asm.js can easily be optimized 

■ future extensions like SlMD.js (vectorized types in 
JavaScript) 


Audio on the WEB 

Asm.js code generation (2) 


function GeometricMean (stdlib, foreign, buffer) { 


var exp = stdlib.Math.exp; 
var log = stdlib.Math.log; 

var values = new stdlib.Float64Array(buffer); 

function logSum( start, end) { 
start = start| 0 ; 
end = end| 0 ; 


// asm.js forces byte addressing of the heap by requiring shifting by 3 
for (p = start « 3 , q = end « 3; (p|0) < (q|0); p= (p+ 8 )| 0 ) { 
sum = sum + +log( values [p»3 ]); 


return +sum; 


function geometricMean (start, end) { 
end = end| 0 ; 

return +exp(+logSum(start, end) / +((end - start)|0)); 


return { geometricMean: geometricMean }; 


Exemple of asm.js module 


Run time normalized to Native (clang -02), lower values are better 


asm.js benchmark (2 to 3 times 
slower than native code...) 
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Asm.js code generation (3) 


Generating asm.js with Emcripten : 

■ Emcripten C/C++ to JavaScript (asm.js) compiler developed 
by Mozilla starting in 2011 

■ Facilitates the port of huge C/C++ codebase on the Web 
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Asm.js code generation (4) 



Asm.js backend in Faust compiler : produces the asm.js module + 
some pure JavaScript helper functions 


function getValue(dsp, offset) { 
dsp = dsp I 0; 
offset = offset I 0; 
return +HEAPF32[dsp + offset » 2]; 


function compute(dsp, count, inputs, outputs) { 
dsp = dsp I 0; 
count = count I 0; 
inputs = inputs I 0; 
outputs = outputs I 0; 
var output0 = 0; 
var fSlow0 = 0.; 
var i = 0; 

output0 = (HEAP32[outputs + (0 « 2) » 2] I 0); 

fSlow0 = +(+(4.65661e-10 * +(+(HEAPF32[dsp + 8 » 2])))); 

for (i = 0; (((i I 0) < (count I 0)) I 0); i = (((i I 0) + 1) I 0)) { 

HEAP32[dsp + 0 + (0 « 2) » 2] 

- (((12345 + — ((imul(1103515245 , (HEAP32[dsp + 0 + (1 « 2) » 2] I 0)) I 0))) I 0)); 

HEAPF32[output0 + ((i I 0) « 2) » 2] 

= +(+(+(+(fSlow0) * +((HEAP32[dsp + 0 + (0 « 2) » 2] I 0))))); 

HEAP32[dsp + 0 + (1 « 2) » 2] = (HEAP32[dsp + 0 + (0 « 2) » 2] I 0); 

} 

} 
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Audio on the WEB 

Asm.js code generation (5) 

Static compilation chain (Faust DSP to asm.js) allows to generate 
self-contained HTML pages. 


faust 



emscripten 



DSP source 
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C++ 
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LLVM IR -► 
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asm.js 









- using emscripten as an intermediate step : 


faust 

DSP source 


asm.js 


- or using direct asm.js code generation 

















































Audio on the WEB 

JavaScript compilation : asm.js generation 


Static compilation chain scripts : 

■ takes Faust DSP, compile it to asm.js, wraps it with additional 
JavaScript code to obtain a fully functional Web Audio node. 

■ wraps the Web Audio node in a HTML template to obtain a 
self-contained DSP node in the page 































Audio on the WEB 

JavaScript compilation : asm.js generation 


Dynamic compilation chain (libfaust.js + asm.js backend) allows to 
embed the complete compilation chain in the browser : 



C++ libfaust 

-► 

libfaust.js 





- first compile C++ libfaust for the Web (libfaust.js) 


libfaust.js 



: JavaScript 



DSP source 


asm.js 

1 

«eval» -► 

Executable code 









- compilation of an asm.js module happens at parse time of the 
source code. If parse time is triggered with ‘eval‘ then dynamic 
compilation occurs. 













































Benchmark of a CPU light application 

Bird ported on the Web 



ooo 

• 

Quitter I’operation 

o 

Inspecter 

Moniteur d’activite 

£chantillonner I'operation 



( Toutes les operations 


AfRcher 

Nom de I’operation 


PID Utilisateur %processeurT 

Fils 

Memoire reelle Type 

(| g, Fi refox 


8237 letz | 32,9 | 

47 

279,3 Mo Intel (64 bits) 

I^J Finder 


300 letz 8,8 

12 

286,7 Mo Intel (64 bits) 

WindowServer 

164 _windowserv 6,7 

5 

240,5 Mo Intel (64 bits) 

A bird 


7986 letz | 3 4 | 

5 

31,4 Mo Intel (64 bits) 































Benchmark of a CPU heavy application 

Yann Orlarey Ethersonik ported on the Web 



Quitter I’operation Inspecter Echantillonner I’operation Afficher 


Nom de I'operation 

PID litilisateur 

% processeur ▼ 

Fils 

Memoire reelle 

Fi refox 

7567 letz 

i ni] 


551,4 Mo 

,4 ethersonik2010 

7582 letz 

IH2] 

5 

49,4 Mo 





























Demo 



■ faust2webaudioasm script 

► From harpsichord.dsp to harpsichord.html 


■ faust2asmjs 

► Harpsichord 

Thomas Cipierre & Laurent Pottier (Saint-Etienne, France) 

► foo-yc20 

Sampo Savolainen (Helsinki, Finland) 


■ libfaust.js 

► FaustPlayground : create Faust patches online 
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Conclusions and perpectives 


■ still some issues with the Web Audio API : implementation, 
performances CPU/latency (audio workers : moving the 
ScriptProcessor nodes in the audio thread) 

■ really usable for serious work? still to be proved... 

■ but at least already usable for deployment, distribution, 
teaching purposes... 
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GRAME - R&D 

Softwares 



Softwares developed in different research projects are freely 
available under GPL/LGPL licenses : 

■ Faust : http://faust.grame.fr : 

► Faust: git.code.sf.net/p/faudiostream/code 

► FaustLive : git.code.sf.net/p/faudiostream/faustlive 

► FaustWorks : 

git.code.sf.net/p/faudiostream/faustworks 

► FaustWeb : 

git://git.code.sf.net/p/faudiostream/faustweb 
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Recent publications on Faust 


■ Denoux, Letz, Orlarey, Fober 2014 : FAUSTLIVE: 
Just-In-Time Faust Compiler... and much more. LAC 2014. 

■ Denoux, Letz, Orlarey, Fober 2014 : FaustLive un compilateur 
a la volee pour Faust ... et bien plus encore, Journees 
d’lnformatique Musicale, Bourges. 

■ Brune de Chiffreville 2014 : Using Faust with Ros. Rapport de 
Stage, GRAME. 

■ Denoux, Letz, Orlarey, Fober 2015 : Composing a web of 
audio applications, WAC 2015, Paris. 

■ Letz, Denoux, Orlarey, Fober 2014 : Faust audio DSP 
language in the Web, LAC 2015 


